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Given an original distribution, its statistical and probabilistic attributes may be 
scanned by the associated escort distribution introduced by Beck and Schlogl and 
employed in the formulation of nonextensive statistical mechanics. Here, the geometric 
structure of the one-parameter family of the escort distributions is studied based on the 
Kullback-Leibler divergence and the relevant Fisher metric. It is shown that the Fisher 
metric is given in terms of the generalized bit-variance, which measures fluctuations of 
the crowding index of a multifractal. The Cramer-Rao inequality leads to the fundamental 
limit for precision of statistical estimate of the order of the escort distribution. It is also 
quantitatively discussed how inappropriate it is to use the original distribution instead of 
the escort distribution for calculating the expectation values of physical quantities in 
nonextensive statistical mechanics. 
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I. INTRODUCTION 



The concept of the escort distributions has been introduced by Beck and Schlogl [1] in 
order to scan the attributes of the original distributions describing the (multi)fractal 
features of nonlinear dynamical systems. Let {/?,} be the original distribution. Then, the 

escort distribution associated with it is given by [1] 



P = L2flAl (I) 



where is a certain positive function. Of particular importance is the case, (f>(s) = s <! 
( < s < 1, q>0), and correspondingly 



>(*) _ w 



(2) 



The parameter, q, is referred to as the order of P^ q) . We mention that the (generalized) 

expectation value with respect to P. q) in eq. (2), termed the ^-expectation value, plays a 

crucial role in the formulation of nonextensive statistical mechanics [2,3]. There exists 
intriguing property [1] concerning the composition law and the group-theoretic structure 
behind eq. (2). Regarding p i — > P. r) as a transformation, P^ q) changes as 
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Therefore, this transformation forms a one-parameter Abelian group with the identity 
transformation corresponding to the order unity. Physical significance of this emerging 
symmetry, however, does not seem to be revealed yet. 

In this article, we study the geometric structure of the space of escort distributions. We 
calculate the Fisher metric along the curve defined by the one-parameter family {/V [ 




and show that it is given by the generalized bit-variance, which describes fluctuations of 
the crowding index of a multifractal. The Cramer-Rao bound is then discussed in 
connection with statistical estimate of the order of the escort distribution. We also discuss 
the Kullback-Leibler divergence between the original and associated escort distributions 
in the case of the ^-exponential distribution in nonextensive statistical mechanics, in 
which the use of the escort distribution for calculating the expectation values is essential. 
In this way, it is quantified how wrong it is to employ the ordinary definition of the 
expectation value in nonextensive statistical mechanics. 

II. FISHER METRIC AND GENERALIZED BIT-VARIANCE 

Let us start by summarizing the basic issues relevant to our discussion. Consider two 
distributions, [k^ and [l? t }. The distance between them may be measured by the 

symmetric Kullback-Leibler divergence 
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D[7t, Tt ] = K[7t \\7t'] + K[7t' II 7X\. 



(4) 



In this equation, K[n II it ] stands for the Kullback-Leibler relative entropy [4] 



(5) 



which is positive semidefinite and vanishes if and only if n i = it , ■ ( V /). 

Suppose Tt ,. be dependent on a set of parameters q = (q\ q 2 , ■ ■•, q"): 7i i = 7t i (q). q 

supplies a local coordinate in the ^-dimensional submanifold of the functional space of 
distributions. Then, the induced metric on this submanifold may be constructed from eq. 
(4). In fact, taking Tt i in the neighborhood of K ( , that is, ,. = Tl t (q + dq), eq. (4) is 

calculated to yield the first fundamental form 



ds 2 = D[7l,7t]= £ g^(q)dq»dq v , 



(6) 



where g^ v is given by 




(7) 
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with the notation 3^ = d Idq^ . The quantity in eq. (7) is called the Fisher metric, or the 

Fisher information, in the literature [5]. It defines the Riemannian geometric structure of 
the submanifold. 

Now, we regard the order of the escort distribution, q, as a parameter. Accordingly, a 
curve is defined by the one-parameter family {^ ( j- To study geometry associated with 
the escort distributions, we measure the distance between P. q) and p. (q+dq) following the 
line mentioned above. From eq. (2), we obtain 



d P (q) 

(</> 9 -/,.)P^, (8) 



dq 



where /, and <I> q are the information content and its ^-expectation value, respectively 
given by 

h=-^ Pi , (9) 



< 



i> q ="L l i p i q) - ( 10 ) 



We notice that in deriving eq. (8) the original distribution is assumed to be independent 
of q. (The situation becomes different in Sec. III.) Using eq. (7) in the one-dimensional 
case, we find 

ds 2 = D[P (q \P (q+dq, ] = (A J) 2 dq 2 . (11) 
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Here, the Fisher metric, (A q I) 2 , is the generalized variance [6] of the information 



content: 



(A q I) 2 =<I 2 > q -<I>l. 



(12) 



This is a generalization of the so-called bit-variance (i.e., the second bit-cumulant) [1], 
and is different from the one discussed in Refs. [7-10], in which statistical properties of 
chaotic dynamical systems are investigated. The ordinary bit-variance is recovered in the 
limit q — > 1. Thus, we find that the bit-variance possesses the geometric meaning as the 
Fisher metric associated with the escort distributions with the different values of the order. 

Now, we wish to point out the relevance of the present discussion to multifractals [1]. 
Let / be the size of a small box whose collection can cover the multifractal phase space. 
The probability attributed to the ith box (centered at a certain point) reads 



where a, is the Lipschitz-Holder exponent, or is commonly referred to as the crowding 

index [1]. Eq. (13) means that the crowding index is essentially the information content. 
Therefore, we see that the Fisher metric in eq. (12) provides fluctuations of the crowding 
index of a multifractal with a natural geometric interpretation. 

Finally, we briefly mention parameter estimation theory for the order of the escort 
distribution. This problem is analogous to estimating temperatures of thermodynamic 



Pi(D~l 



(13) 
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systems [11]. It is known that the Fisher information is related to the problem of 
statistical parameter estimation. For the unbiased estimator of q, the size of error in 
estimation, 8q, obeys the Cramer-Rao inequality [5,11] 



Therefore, the generalized bit-variance as the metric gives the fundamental limit for 
precision of estimate of the order of the escort distribution. 



This section is devoted to calling attention to crucial importance of employing the 
escort distribution for calculating the expectation values of physical quantities in 
nonextensive statistical mechanics [2,3,12] based on the Tsallis entropy [13]. This is 
because there still seems to be confusion caused by published works that employ the 
ordinary definition of the expectation values with respect to the original distribution. 

The stationary distribution in nonextensive statistical mechanics is the "^-exponential 
distribution", which has the following form: 



(8q) 2 x(A q I) 2 >l. 



(14) 



III. KULLBACK-LEIBLER DIVERGENCE 



FOR ^-EXPONENTIAL DISTRIBUTION 



p(x) = 



1 



e q (-Ax), 



(15) 
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Z q (X) = ^dxe q {-Xx), 



(16) 



where X is the factor related to the Lagrange multiplier associated with the ^-expectation 
value of x calculated by the use of the escort distribution, as in eq. (10). (In the 
subsequent discussion, X is nothing but a parameter.) Also, here and hereafter, a 
continuous random variable, x (> 0) , is considered for the sake of simplicity of the 
discussion. In eqs. (15) and (16), e q (s) stands for the "^-exponential function" defined by 

e q {s) = {\ + {\-q)s)^- q) (17) 

with the notation: (A) + = max {0, A}. In the limit q — > 1, eq. (15) tends to the familiar 
Boltzmann-Gibbs-type exponential distribution. Clearly, the distribution in eq. (15) is 
normalizable if and only if q < 2, leading to Z q (X) = [(2 - q) A] -1 . 

In the case when l<g<2, the original distribution in eq. (15) is of the Zipf- 
Mandelbrot type and decays as a power law for large values of x. Accordingly, all of its 
moments are divergent. This is a feature in common with the Levy distribution in half 
space, and in fact the original distribution converges to the Levy distribution by the 
repeated convolution operations in conformity with the Levy-Gnedenko generalized 
central limit theorem [14]. Therefore, in this case, the use of the ^-expectation values is 
essential for calculating finite moments to investigate, e.g., the maximum entropy 
principle. Furthermore, it has been shown [15] that in nonextensive statistical mechanics 
the ordinary expectation value has to be replaced by the ^-expectation value, in order to 
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be consistent with the nonextensive generalization of the method of steepest descents 
developed by Fowler and Darwin for establishing the statistical foundation for the 
canonical ensemble theory. 

The situation is different when < q < 1 . In this case, the original distribution in eq. 

(15) is support compact, < x < [(1 - q)X]~\ and therefore all the moments are finite. 
However, the use of the escort distribution still has to be respected, since eq. (15) itself is 
derived by maximization of the Tsallis entropy under the constraint on the ^-expectation 
value of x. (For the entropic basis of the q-exponential distribution, see Ref. [16].) To 
quantify the discrepancy between the original distribution, p{x), and its associated escort 

distribution, P (q) (x) = [p(x)] q I \dx' [p(x')] q , again we calculate the Kullback-Leibler 

divergences. The results are 

K[P (q) \\p] = l-q-\n(2-q), (18) 

K[p\\P (q) ] = \n(2-q)-^-, (19) 

2-q 



D[P (q \p] = ( ±-^, (20) 
2-q 



which turn out to hold also in the case 1 < q < 2 . In the range < q < 1 , D monotonically 
decreases from 1/2 to as q varies from to 1. For example, q-l/2 gives rise to 
D - 1 / 6, which is about 33% of the value of the largest value of the discrepancy, 1/2. 
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This fact quantitatively illustrates how wrong it is to employ the original distribution to 
calculate the expectation values in nonextensive statistical mechanics. 



IV. CONCLUSION 



We have studied geometry associated with the escort distributions by making use of 
the Kullback-Leibler divergence and the Fisher metric. We have shown that three 
concepts, i.e., the lower bound of error in estimation of the order of the escort distribution, 
he bit-variance, and fluctuations of the crowding index of a multifractal, are all endowed 
with their geometric interpretations. We have also quantitatively discussed how 
inappropriate it is to use the original distribution instead of the escort distribution in 
nonextensive statistical mechanics. 

In the present work, we have employed the ordinary Kullback-Leibler divergence. 
There is a possibility of using the generalized Kullback-Leibler divergence (associated 
with the Tsallis entropy [13]) introduced and discussed in Refs. [17-22]. As shown in 
Refs. [17,18], in this case, the corresponding Fisher metric is globally conformally 
equivalent to the ordinary one in eq. (7). 
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